Non-factorizable joint probabilities and evolutionarily stable strategies 
in the quantum prisoner's dilemma game 



Azhar IqbaP'*" and Derek Abbott'' 
''School of Electrical & Electronic Engineering, The University of Adelaide, SA 5005, Australia. 
'^Centre for Advanced Mathematics and Physics, National University of Sciences & Technology, 
Campus of College of Electrical & Mechanical Engineering, Peshawar Road, Rawalpindi, Pakistan. 

Abstract 

The well known refinement of the Nash Equilibrium (NE) called an Evolutionarily Stable 
Strategy (ESS) is investigated in the quantum Prisoner's Dilemma (PD) game that is played 
using an Einstein-Podolsky-Rosen type setting. Earlier results report that in this scheme the 
classical NE remains intact as the unique solution of the quantum PD game. In contrast, we 
show here that interestingly in this scheme a non-classical solution for the ESS emerges for 
the quantum PD. 
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1 Introduction 

In the area of quantum games [1-38], a result from a recent paper [28] shows that, in the quan- 
tization scheme based on performing generalized Einstein-Podolsky-Rosen-Bohm (EPR-Bohm) 
experiments [39-44], the two-player quantum game of Prisoner's Dilemma (PD) does not offer a 
new Nash Equilibrium (NE0) [45,46], which is different from the classical NE of the game in which 
both players play the strategy of defection. This quantization scheme constructs the quantum PD 
in two steps: 

1) The players' payoff relations are re-expressed in terms of joint probabilities corresponding 
to generalized EPR-Bohm experiments involving a bipartite system shared between two players. 
In a run each player receives one part of the system while having two observables both of which 
are dichotomic. A player's strategy is defined to be entirely classical that consists of a linear 
combination (with real and normalized coefficients) of choosing between his/her two observables. 
The scheme embeds the classical game within the quantum game by placing constraints on joint 
probabilities. These constraints guarantee that for factorizable joint probabilities the classical 
game emerges along with its particular outcome. 

2) As a set of joint probabilities that violates Bell's inequality must always be non-factorizable, 
the corresponding quantum game is constructed by retaining the constraints on joint probabilities, 
obtained in the last step, while they can now be non-factorizable. 

By constructing quantum games from non-factorizable joint probabilities, which a quantum 
mechanical apparatus can provide, this quantization scheme avoids state vectors and brings out the 
essence of quantum games without referring to quantum mechanics — an important consideration 
in developing the present approach to quantum games. Game theory finds applications in a range 
of disciplines [47] and we believe that more accessible approaches to quantum games remain in 
need of development. 

It turns out that in this quantization scheme the constraints on joint probabilities obtained 
for the game of PD, which embed the classical game within the quantum game, come out to be 
so strong that the subsequent permitting joint probabilities to become non-factorizable cannot 
change the outcome of the game. The quantum PD game that is played in this framework, 



^In the rest of this paper we use NE to mean Nash Equilibrium or Nash Equilibria. The correct meaning is 
judged from the context. 



therefore, generates an outcome identical to the one obtained in the classical game in which both 
players defect. This finding motivates us in the present paper to investigate if non-factorizable 
joint probabilities can bring out some non-classical outcome for a refinement of the NE in the PD 
game, while not affecting the NE itself. 

In this paper wc show that surprisingly this indeed is the case. That is, with an EPR-Bohm 
type setting for playing a quantum game a set of non-factorizable joint probabilities is able to 
produce a non-classical outcome in the quantum PD game to a well known refinement on the 
set of symmetric Nash equilibria — called an Evolutionarily Stable Strategy (ESS) [48-50]. This 
contrasts interestingly with the reported result [28] that for the same game, non-factorizable joint 
probabilities are unable to produce a non-classical outcome for a NE and the classical NE remains 
intact as the unique solution of the quantum PD game. 

Using the quantization schemes of Eisert et al. [5] and Marinatto and Weber [11], the game- 
theoretic concept of an ESS was originally investigated in the area of quantum games by Iqbal 
and Toor in a scries of papers [12, 14, 17, 20, 24] and was reviewed by Iqbal and Cheon in a book 
chapter [33]. The present paper addresses the issues raised in these publications using the new 
approach towards constructing quantum games recently proposed by Iqbal and Cheon [28], which 
exploits non-factorizable property of quantum mechanical joint probabilities in the construction 
of quantum games. 

In a recent paper [36] we have investigated a quantum version of the Matching Pennies game 
played in this quantization scheme to find that non-classical NE emerge in this game for sets of 
(quantum mechanical) joint probabilities that maximally violate CHSH form of Bell's inequal- 
ity [43]. The present paper considers the PD game in this quantization scheme and explores the 
fate of a well known refinement of the NE concept in relation to joint probabilities becoming 
no n- factor iz able . 

2 Evolutionarily Stable Strategy 

An ESS is the central solution concept of evolutionary game theory [49,50] (EGT). In EGT genes 
are considered players in survival games and players' strategies are the behavioral characteristics 
imparted by genes to their host organism, while the payoff to a gene is the number of offspring 
carrying that gene [50]. The players' strategies (which the players genes play until the biologi- 
cal agents carrying those genes die) and their payoffs become related as host organisms having 
favourable behavioral characteristics arc better able to reproduce than others. 

Referring to a pool of genes, the notion of an ESS considers a large population of players 
(genes) in which players are matched in random pair- wise contests. We call the two players in an 
interaction to be player 1 and player 2. Each player can play the strategy S or the strategy S' in 
a pair-wise interaction and the payoff matrix for the game is given as 

Player 2 

S S' 

Playerl ^, ^^^^^^^ ^^^^^^^ J, (1) 

where the two entries in the bracket are player I's and player 2's strategics, respectively. For 
example, player I's payoff is Ili{S,S) = ai when both players play the strategy S. It is found 
useful to define 

^-{z ill I:) 

to be player I's and player 2's payoff matrices, respectively. We write players' payoffs as ni_2(a^j y) 
where subscripts 1 or 2 refer to the players and x and y in bracket are player I's and player 2's 
strategies, respectively. 

An ESS deals with symmetric games in which 



Tli{x,y) = 112(2;, a;) and Ili{y,x) = 112 (3) 

saying that, for example, player I's payoff when s/he plays x and player 2 plays y, is same as the 
player 2's payoff when s/he plays y and player 1 plays x, where x and y can be either S or S' . 
In words, in a symmetric game a player's payoff is determined by the strategy, and not by the 
identity, of a player. 

For a symmetric game using subscripts in payoff relations becomes redundant as n(a;, y) denotes 
payoff to an x-player against a y-player. This allows not to refer to players at all and to describe 
Il{x,y) as the payoff to x-strategy against the y-strategy. The game given by the matrix ([T]) is 
symmetric when A — . The game of PD is a symmetric game, which is defined by the constraint 
03 > ai > 04 > 02. 

Assume that, in random pair-wise contests, the strategy x is played by a number of players 
whose relative proportion in the population is e whereas the rest of the population plays the 
strategy x* . EGT defines the fitnesses [49,50] of the strategies x and x* as 

F{x) = en(x, x) + (1 - e)Ii{x, y), F{x*) = en{x\x) + (1 - e)U{x*,x*), (4) 
in terms of which the strategy x* is called an ESS when F{x*) > F{x) i.e. 

eU{x*, x) + (1 - e)U{x*,x*) > en(a;, x) + {1 - e)U{x, x*). (5) 

Since e ^ f, the terms containing e can be ignored effectively. So F{x*) > F{x) implies 
Il{x*,x*) > n(a;,a:;*). If, however, Il{x*,x*) — Il{x,x*), we need to consider the terms con- 
taining e. In this case, F{x*) > F{x) requires that I{{x* ,x) > Il{x,x). We then define an strategy 
X* to be evolutionarily stable iff for all strategies x ^ x* either 

1) either n(x*, x") ~ U{x, x*) > or if 
2) Il{x*, X*) = n(a;, x*) then n{x*,x) - U{x, x) > 0. (6) 

This definition shows that an ESS is a symmetric NE [49, 50] satisfying an additional stability 
property. The stability property ensures that [50] if an ESS establishes itself in a population, it is 
able to withstand pressures of mutation and selection. Using a game-theoretic wording, an ESS is 
a refinement on the set of symmetric Nash equilibria and, though being a static solution concept, 
it describes dynamic evolutionary situations. 

3 ESS in Prisoner's Dilemma when joint probabilities are 
factorizable 

We consider game-theoretic solution-concept of an ESS in quantum mechanical regime by observ- 
ing that quantum mechanics can make only probabilistic predictions and any setup for a quantum 
game must have a probabilistic description. That is, when a quantum game is constructed using 
joint probabilities, even the so-called one-shot game must first be translated into some appro- 
priate probabilistic version before one considers its quantum version. This translation permits 
us, in the following step, to introduce (quantum mechanical) joint probabilities (that may not be 
factorizable) and to find if and how such probabilities can change the outcome of the game. 

To achieve this in view of the ESS concept, we consider an EPR-Bohm type setting [28] 
consisting of a bipartite dichotomic physical system that the two players share to play the game 
((!]). This system can be described by the following 16 joint probabilities pi with 1 < i < 16: 

ft = Pr(7ri,^2;a,6) with i = 1 + ii^M + 2^^^^ + 4(6 - 1) + 8(a - 1), (7) 

where tti is player I's outcome, that can have a dichotomic value of +1 or —1, obtained when 
s/he plays the strategy S or S' . We associate 5 ~ 1 and S" ~ 2 that then assigns a value for a. 



Similarly, 7r2 is player 2's outcome, that can have a dichotomic value of +1 or —1, obtained when 
s/he plays the strategy S or S". The same association S ^ 1 and S' ^ 2 then assigns a value for 
b. For example, the joint probability corresponding to the situation when player I's outcome tti 
is +1 when s/he plays S' (i.e. a = 2), while player 2's outcome 7T2 is —1 when s/he plays S (i.e. 
b = 1), is obtained from ([7]) as pio- 

We now define players' payoff relations when they play the game ([T]) using this (probabilistic) 
physical system to which the 16 joint probabilities ([7]) correspond, 

where 



nA,B(S",S') = X]i=9(a'^)i-8Pi, 11^,5(5", S") = I]j=13(a'^)j-12Pi- (9) 

Here T indicates transpose and x and y are the probabilities, definable over a large number of 
runs, with which Alice and Bob choose the strategies S and S", respectively. Joint probabilities 
are normalized i.e. 

Etl P^ = ^= ELs E»=9 p. = 1 = T,]tl3 P^■ (10) 

A Nash equilibrium strategy pair {x*,y*) is then obtained from the inequalities: 

IlA{x*,y*) - HAix, y*) ^ 0, 05(2:*, y*) - ^b{x* ,y) ^ 0, (11) 
and a symmetric game, defined by the conditions ([3]), is obtained when 



^a{s',s) = Ub{s,s'), iiA{s',s') = nB{s\s'). (12) 

As it is reported in Ref. [28], in case joint probabilities are factorizable one can find r, s, r', s' € [0, 1] 
such that [28] 



= rr', p2= r{l - r'),...ps= (1 - r){l - s'), 
P9 = sr', pio= s(l - r'),...pi6= (1 - s)(l - s'), (13) 

and the Nash inequalities (fTTj) are reduced to [28] 

(r - ^fA{y*iT' ~ §')+§'} i^"- - ^ 0, {:E'^(r - §)^ + f} S(r'-§')(?/ - ?y) ^ 0, (14) 



where r= 

When joint probabilities are factorizable, the conditions (jl2p to obtain a symmetric game can 
be shown to reduce to .4 = B'^ and the payoff relations ([8]) are then simplified to 



T 



^^^^y^ " ( i-x ) ( n(?',?) n(?',50 ) ( 1 ^ ) ' 



where 



0(5, S*) r^TWr', n(S',S") =r^M§', 

U{S',S) = Mr' , n{S' , S') = f M^' , (16) 



and A4 = A = B . The second inequality in pT|) is IlBix*,y*) — IlBix*,y) > that becomes 
nyi(y*, x*) — 11^(2/, X*) > for a symmetric game. Comparing it to the first inequahty in pT|) gives 
X* = y* and x — y and the definition of a symmetric NE is reduced simply to Il{x* , x*)—Il{x, x*) ^ 
0. 

Evaluating the two parts of the ESS definition ([6]) from a symmetric game payoff relations (llSp 
we find 

n(a;*,a;*) - U{x,x*) = {x* - x)(a;*Ai + A2), n(a;*,a;) - U{x,x) = {x* - x){xAi + A2) (17) 

where Ai = (0(5*, S) - U{S' , S) - U{S, S') + n(S", S") and A2 = n(S', 5") - n(S", S'). Now Ai 
and A2 are evaluated using as 

Ai^ {r- s){r' - s')fli and A2 = (r - s)(s'f7i - ^^2), (18) 

where fii = ai — 02 — 03 + 04 and 512 =04 — 02- Recall that PD is defined by the constraints 

03 > fli > 04 > 02 and we have > 0, which asks for a natural association of the strategy of 
defection in PD to the strategy x* — played in the present setting. When both players play this 
strategy we obtain from the Eq. (jlSp 11(0,0) — 11(5", S"), which is the payoff to each player in 
the classical game when they both defect. With this association Eqs. (fT7|) give 11(0, 0) — ll{x, 0) = 
— XA2 and n(0, x) — Tl{x, x) = — a;(xAi + A2), which correspond to the first and second parts of 
the ESS definition ([6]), respectively. For this strategy if we take 

s'^r^s/f^i, r-s = r' -s' (19) 
then the two parts of the ESS definition are reduced to 

n(o, 0) - n{x, 0) = 0, n(o, x) - n{x, x) = ~x'^{r ~ sfQi. (20) 

As ill = Q2 - ^3, where il^ = (03 - oi), for PD both fl2,^3 > 0. As 172 > and s' = ^2/^1 
is a probability we require the constraint 1 > ^2/^1 > so ili > Q2 > 0, from which one obtains 
Q2 > ^3 i.e. 

04 — 02 > 03 — oi (21) 

along with this, of course, we also have 03 > oi > 04 > 02. The extra requirement (|21|) defines a 
subset of the games that are put under the name of a generalized PD. For this game the result (I20p 
states that the strategy a;"^ = is not an ESS, though it is a symmetric NE, when joint probabilities 
are factorizable, in the sense described by ([13]), and have the constraints (fT9|) imposed on them. 

4 Obtaining the quantum game 

There can be several different possible routes in obtaining a quantum game. The general idea is 
to establish correspondence, as a first step, between classical feature of a physical system and a 
classical game in the sense that classical game results because of those features. In the following 
step, the classical feature are replaced by quantum feature, while the obtained correspondence 
in the first step is retained. One then looks at the impact which the quantum feature has on 
the solution/outcome of the game under consideration. As the mentioned correspondence can be 
established in several possible ways, there can be many different routes in obtaining a quantum 
game. 

To consider ESS in quantum PD we translate playing of this game in terms of factorizable 
joint probabilities, which is achieved in the previous Section. We then find constraints on these 
probabilities ensuring that the classical game remains embedded within the quantum game, which 
is achieved by Eq. For factorizable joint probabilities the Ec^s. (|13p hold that permit us 

to translate the constraints (jl9[) in terms of joint probabilities. In the following step, the joint 



probabilities are allowed to be non-factorizable, while they continue to be restricted by the obtained 
constraints. 

Joint probabilities pi become non-factorizable when one cannot find r, s, r', s' G [0, f ] such that 
Pi can be expressed in terms of them i.e. as given in (fT3|) . The same payoff relations ([8]), therefore, 
correspond to the qunatum game, whose parts are given by ([9|), and players' strategies remain 
exactly the same. 

We require that the constraints (jl9p . when they are re-expressed using (1131) in terms of joint 
probabilities pi, remain valid while pi are allowed to be non-factorizable. We notice that Eqs. (|13p 
allow re-expressing the constraints (jl9p in terms of pi as 

r=Pi+P2, r'=pi+p3, s=P9+Pio, s'=p5+p7, (22) 
and the constraints (fT9|) take the form 

P5+P7 = ^2/^1, Pi +P2 -P9 -PlO =Pl +P3 -P5 -P7- (23) 

At this stage we refer to the analysis of joint probabilities in generalized EPR-Bohm experi- 
ments by Cereceda [44] reporting that eight out of sixteen joint probabilities can be eliminated 
using the normalization constraints (jlOp and the causal communication constraints given as fol- 
lows, 

Pl+P2=P5+P6^ Pl+P3= P9+Pll^ P9+PlQ^ P13+P14., P5+P7= P13+P15: (24) 
P3+P4^P7+P8, Pll+Pl2^ P15+P16' P2+P4^ P10+P12, P6+Ps= Pu+Pl6- 

The constraints PHIIM)) . of course, do hold for factorizable joint probabilities that are given by 
Eqs. Cereceda expresses probabilities p2, Ps, Pe, P7i Pw, Pii, Pi3, Pie in terms of probabilities 

Pi, Pi, P5, Ps, P9, P12, Pi4, Pi5 as 



P2^ (1 - Pl-p4+P5~Ps-P9+Pl2+Pl4~Pl5)/'^, P3= (1 - Pi -J34 -Ps+Ps +P9 "^12 -Pl4+Pl5 )/2, 

Pe= (1 +Pi-p4-p5-ps-p9-hPi2+?'l4-Pl5)/2, P7^ (1 - Pi+]54-p5-p8+P9-Pl2-Pl4+Pl5)/2, 

PW= (1 - P^+P4+P5-Ps-P9-Pl2+Pl4-Pl5)/'^, Pll= + Pl-Pi-P5+Ps-P9-Pl2-Pu+Pl5)/'^, 
Pl3= (1 - Pi+Pi+P5-P8+P9-Pl2-Pl4:-Pl5) Pl6= + Pl-Pi-P5+P8-P9+Pl2-Pl4-Pl5) f^, 

(25) 

and the payoff relations ([8]) now involve only eight 'independent' probabilities. 

5 ESS in quantum Prisoner's Dilemma 

For the strategy of defection (x* — 0) in the quantum game with payoff relations ([8]), the ESS 
definition §^ and Eqs. ^ give 

n(o, 0) - n(x, 0) = X {n(s", s') - u{s, s')} , (26) 

which is equated to zero so that the strategy x* — remains a symmetric NE in the quantum 
game, as it is the case in the game when joint probabilities are factorizable, and which is described 
by Eqs. With setting n(S", S') = Il{S, S") the second part of the ESS definition ® , which 

is evaluated in (fT7|) . reduces itself to 

n(o, x) ~ n{x, x) = x^ {u{s', s) - u{s, s)} . (27) 

With Cereceda's analysis and using Eqs. ((25| . setting 11(5', S') — 11(5", 5') = results in 

Pl+P5+Ps+Pl2+Pl4.+Pl5^ 1 +P4+P9. Pi+P5+Ps+P9+Pl4+Pl5= ^ + P1+P12, (28) 

and under the constraints (|28p the strategy x* = then remains a symmetric NE even for non- 
factorizable joint probabilities. Also, using Eqs. ([25| the constraints ([23|) can be re-expressed in 
term of 'independent probabilities' as 



(1 -Pl+P4 +P5 -P8+P9 -Pl2 ~Pl4 +P15) = ^2/^1, P5 + Pl2 = PS +P9, (29) 

which allows us to arbitrarily eliminate probabilities pi and pi2 from the constraints (|28p to 
re-express them as 

P5 + Pl5 ^ ^2/^1, P8 +P14 = 1 - f^2/fil- (30) 

Using Eqs. while considering the strategy x* — Q for the second part of the ESS definition 
the Eq. (l27l) becomes 

n(0, x) ~ n(x, x) = x^ {r!3(Pi - Pg) + ^2{pi2 " P4)} , (31) 

which simplifies further when we eliminate p\ and pi2 using (j29p and afterwards eliminate pi4 and 
Pi5 using ((28)) to obtain 

n(0,a;) -n(x,x) =x2(p8+P9-p4-P5)f^i. (32) 
As fii > 0, the strategy x* = thus becomes an ESS if 

Ps +P9 > P4 +P5, (33) 

and when joint probabilities pi satisfy constraints (j29l I28p . along with the constraints given by 
normalization and causal communication. 

6 Discussion 

The game-theoretic solution concept of an ESS is investigated within a quantization scheme that 
constructs quantum games from the non-factorizable property of quantum mechanical joint prob- 
abilities. Neither entanglement nor violation of Bell's inequality [41,43] is used explicitly in this 
construction [53]. 

Eq. (|32|) shows that probabilities p4, ps, pg, pg can be taken to be 'independent' as, out of the 
remaining four probabilities, the probabilities pi4 and pis are obtained from (|30p and probabilities 
pi and pi2 are obtained from ([29ll . The remaining eight probabilities p2, Pa, P&^ Pi, Pio, Pii, Pis, 
Pi6 are then obtained from (|25p . The scheme used to obtain a quantum game assumes that 
a set of non-factorizable joint probabilities, which satisfies normalization pop and the causal 
communication constraint Ij24p can always be generated by some bipartite quantum state (pure or 
mixed) provided that the set does not violate CHSH form of Bell's inequality beyond Cirel'son's 
hmit [54]. 

A natural question here is to ask if Bell's inequality is violated by requiring -|-pg > p4 -l-ps, 
which makes the strategy of defection {x* = 0) an ESS. To answer this we consider probabilistic 
form [44] of CHSH version of Bell's inequality [43] expressed as —2 < A < 2 where A = 2{pi + 
Pi + P5 + Ps + P9 + Pi2 + Pi4 + Pi5 - 2). We insert values for pi, pi2, pu, pi5 using ([29l [30]) to 
obtain 

A = 2(2p4+P9-1). (34) 

Now, comparing ([M]) to ([55)) shows that the violation of the CHSH inequality is not essential 
for the strategy of defection to be an ESS for a set of non-factorizable probabilities, when for a 
factorizable set of probabilities this strategy is non-ESS and a symmetric NE only. 

To summarize, a non-classical solution for an ESS in the quantum PD game has been shown 
to emerge due to joint probabilities that are non-factorizable. An ESS offers a stronger solution 
concept than a NE and we consider the situation in which the same NE, consisting of the strategy 
of defection on behalf of both players, continues to exist in both the classical and the quantum 
versions of the PD game, which correspond to situations of joint probabilities being factorizable 
and non-factorizable, respectively. It is shown that non-factorizable quantum joint probabilities 



can bring evolutionary stability to the strategy of defection via the 2nd part of the ESS definition 
®. 
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